[2026-08-06 07:24:59,535] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096016.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096016.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096020.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096022.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096020.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096022.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096020.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,535] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096022.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:24:59,539] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096016.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:24:59,539] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096018.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:24:59,539] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096020.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:24:59,539] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096022.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:25:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81509, size=167, lastModifiedTime=1786000764027, largestRecordTimestamp=Some(1786000764013)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,811] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81508, size=168, lastModifiedTime=1786000695402, largestRecordTimestamp=Some(1786000695392)) (kafka.log.LocalLog$)
[2026-08-06 07:25:02,822] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081508.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,822] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081508.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081508.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,824] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081508.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:25:02,824] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81510 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4411660, size=307813, lastModifiedTime=1786000756159, largestRecordTimestamp=Some(1786000756161)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,829] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81102, size=166, lastModifiedTime=1786000695530, largestRecordTimestamp=Some(1786000695521)) (kafka.log.LocalLog$)
[2026-08-06 07:25:02,829] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081102.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,830] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081102.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,830] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081102.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,830] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081102.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:25:02,830] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4412187 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,833] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81103, size=165, lastModifiedTime=1786000764167, largestRecordTimestamp=Some(1786000764157)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,834] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81104 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,836] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1413, size=4584, lastModifiedTime=1786000738847, largestRecordTimestamp=Some(1786000738847)) (kafka.log.LocalLog$)
[2026-08-06 07:25:02,836] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0/00000000000000001413.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,837] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0/00000000000000001413.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,837] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0/00000000000000001413.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:25:02,837] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4412108, size=305683, lastModifiedTime=1786000756115, largestRecordTimestamp=Some(1786000756116)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,838] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0/00000000000000001413.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:25:02,839] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4412633 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,864] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1436, size=1978, lastModifiedTime=1786000750839, largestRecordTimestamp=Some(1786000750841)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:25:02,865] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Incremented log start offset to 1437 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:25:07,164] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81108 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:25:07,178] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81108 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:25:07,182] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96026 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:25:07,184] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96026 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:25:13,045] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413153 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:25:13,058] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4413153 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:26:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81510, size=168, lastModifiedTime=1786000832664, largestRecordTimestamp=Some(1786000832653)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81509, size=167, lastModifiedTime=1786000764027, largestRecordTimestamp=Some(1786000764013)) (kafka.log.LocalLog$)
[2026-08-06 07:26:02,821] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081509.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,822] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081509.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081509.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81511 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,824] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081509.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:26:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4412187, size=34383, lastModifiedTime=1786000842844, largestRecordTimestamp=Some(1786000842849)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4412284 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,829] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4411660, size=307813, lastModifiedTime=1786000756159, largestRecordTimestamp=Some(1786000756161)) (kafka.log.LocalLog$)
[2026-08-06 07:26:02,830] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004411660.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,830] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004411660.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,830] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004411660.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,831] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004411660.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:26:02,831] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81104, size=166, lastModifiedTime=1786000832784, largestRecordTimestamp=Some(1786000832778)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,833] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81105 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,833] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81103, size=165, lastModifiedTime=1786000764167, largestRecordTimestamp=Some(1786000764157)) (kafka.log.LocalLog$)
[2026-08-06 07:26:02,834] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081103.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,834] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081103.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,834] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081103.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,834] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081103.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:26:02,836] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4412633, size=36824, lastModifiedTime=1786000843004, largestRecordTimestamp=Some(1786000843009)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,837] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4412737 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,838] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4412108, size=305683, lastModifiedTime=1786000756115, largestRecordTimestamp=Some(1786000756116)) (kafka.log.LocalLog$)
[2026-08-06 07:26:02,838] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412108.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,838] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412108.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,838] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412108.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,839] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412108.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:26:02,842] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 1438 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:26:02,844] INFO [ProducerStateManager partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1] Wrote producer snapshot at offset 1438 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:26:02,844] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1437, size=1522, lastModifiedTime=1786000836412, largestRecordTimestamp=Some(1786000836402)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,846] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Incremented log start offset to 1438 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:26:02,864] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1436, size=1978, lastModifiedTime=1786000750839, largestRecordTimestamp=Some(1786000750841)) (kafka.log.LocalLog$)
[2026-08-06 07:26:02,865] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001436.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,865] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001436.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,865] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001436.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:26:02,865] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001436.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:26:15,796] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81110 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:26:15,808] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81110 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:26:15,812] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96028 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:26:15,814] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96028 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:27:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81510, size=168, lastModifiedTime=1786000832664, largestRecordTimestamp=Some(1786000832653)) (kafka.log.LocalLog$)
[2026-08-06 07:27:02,811] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081510.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,811] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081510.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,811] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081510.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,812] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3, dir=/var/lib/kafka/data] Rolled new log segment at offset 1404 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:27:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081510.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:27:02,825] INFO [ProducerStateManager partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3] Wrote producer snapshot at offset 1404 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:27:02,825] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1402, size=4016, lastModifiedTime=1786000894224, largestRecordTimestamp=Some(1786000894230)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:27:02,827] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3, dir=/var/lib/kafka/data] Incremented log start offset to 1404 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:27:02,828] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4412187, size=34383, lastModifiedTime=1786000842844, largestRecordTimestamp=Some(1786000842849)) (kafka.log.LocalLog$)
[2026-08-06 07:27:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412187.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412187.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,829] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412187.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412187.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:27:02,831] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4412284, size=197622, lastModifiedTime=1786000905272, largestRecordTimestamp=Some(1786000905275)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:27:02,832] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81104, size=166, lastModifiedTime=1786000832784, largestRecordTimestamp=Some(1786000832778)) (kafka.log.LocalLog$)
[2026-08-06 07:27:02,832] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081104.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,832] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081104.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,832] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081104.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,832] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4412609 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:27:02,833] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081104.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:27:02,835] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81105, size=334, lastModifiedTime=1786000901404, largestRecordTimestamp=Some(1786000901408)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:27:02,836] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4412633, size=36824, lastModifiedTime=1786000843004, largestRecordTimestamp=Some(1786000843009)) (kafka.log.LocalLog$)
[2026-08-06 07:27:02,836] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412633.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,836] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412633.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,836] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412633.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,836] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81107 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:27:02,837] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412633.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:27:02,839] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4412737, size=202973, lastModifiedTime=1786000905304, largestRecordTimestamp=Some(1786000905310)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:27:02,841] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4413067 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:27:02,844] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1437, size=1522, lastModifiedTime=1786000836412, largestRecordTimestamp=Some(1786000836402)) (kafka.log.LocalLog$)
[2026-08-06 07:27:02,845] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001437.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,845] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001437.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,845] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001437.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:27:02,846] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001437.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:27:24,418] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81112 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:27:24,432] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81112 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:27:24,437] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96030 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:27:24,438] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96030 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:27:24,564] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81514 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:27:24,573] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81514 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:27:46,680] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413156 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:27:46,694] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4413156 with 0 producer ids in 15 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:27:46,762] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4412693 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:27:46,770] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4412693 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:28:02,811] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2, dir=/var/lib/kafka/data] Rolled new log segment at offset 1344 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:28:02,824] INFO [ProducerStateManager partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2] Wrote producer snapshot at offset 1344 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:28:02,824] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1343, size=1526, lastModifiedTime=1786000965081, largestRecordTimestamp=Some(1786000965085)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,826] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1402, size=4016, lastModifiedTime=1786000894224, largestRecordTimestamp=Some(1786000894230)) (kafka.log.LocalLog$)
[2026-08-06 07:28:02,826] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3/00000000000000001402.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,826] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3/00000000000000001402.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,826] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3/00000000000000001402.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,826] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2, dir=/var/lib/kafka/data] Incremented log start offset to 1344 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,827] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3/00000000000000001402.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:28:02,831] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81511, size=168, lastModifiedTime=1786000969913, largestRecordTimestamp=Some(1786000969900)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,831] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4412284, size=197622, lastModifiedTime=1786000905272, largestRecordTimestamp=Some(1786000905275)) (kafka.log.LocalLog$)
[2026-08-06 07:28:02,832] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412284.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,832] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412284.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,832] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412284.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,832] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81512 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,832] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412284.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:28:02,835] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81105, size=334, lastModifiedTime=1786000901404, largestRecordTimestamp=Some(1786000901408)) (kafka.log.LocalLog$)
[2026-08-06 07:28:02,835] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081105.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,835] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4412609, size=29771, lastModifiedTime=1786000970125, largestRecordTimestamp=Some(1786000970131)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,835] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081105.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,835] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081105.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,837] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081105.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:28:02,837] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4412693 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,839] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4412737, size=202973, lastModifiedTime=1786000905304, largestRecordTimestamp=Some(1786000905310)) (kafka.log.LocalLog$)
[2026-08-06 07:28:02,839] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81107, size=165, lastModifiedTime=1786000970049, largestRecordTimestamp=Some(1786000970049)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,840] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412737.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,840] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412737.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,840] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412737.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:28:02,841] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81108 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,841] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004412737.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:28:02,844] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413067, size=30514, lastModifiedTime=1786000970085, largestRecordTimestamp=Some(1786000970089)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:28:02,846] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4413153 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:28:33,060] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81113 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:28:33,073] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81113 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:28:33,077] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96032 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:28:33,079] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96032 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:28:44,553] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-19 (kafka.log.LogCleaner)
[2026-08-06 07:28:44,553] INFO Cleaner 0: Building offset map for __consumer_offsets-19... (kafka.log.LogCleaner)
[2026-08-06 07:28:44,558] INFO Cleaner 0: Building offset map for log __consumer_offsets-19 for 4 segments in offset range [96024, 96032). (kafka.log.LogCleaner)
[2026-08-06 07:28:44,559] INFO Cleaner 0: Offset map for log __consumer_offsets-19 complete. (kafka.log.LogCleaner)
[2026-08-06 07:28:44,559] INFO Cleaner 0: Cleaning log __consumer_offsets-19 (cleaning prior to Thu Aug 06 07:27:24 GMT 2026, discarding tombstones prior to upper bound deletion horizon Wed Aug 05 07:22:50 GMT 2026)... (kafka.log.LogCleaner)
[2026-08-06 07:28:44,559] INFO Cleaner 0: Cleaning LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786000970049, largestRecordTimestamp=Some(1786000970054)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914570049 computed from the segment last modified time of 1786000970049,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:28:44,560] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96024, size=366, lastModifiedTime=1786001038666, largestRecordTimestamp=Some(1786001038669)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914570049 computed from the segment last modified time of 1786001038666,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:28:44,560] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96026, size=366, lastModifiedTime=1786001107286, largestRecordTimestamp=Some(1786001107288)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914570049 computed from the segment last modified time of 1786001107286,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:28:44,560] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96028, size=366, lastModifiedTime=1786001175919, largestRecordTimestamp=Some(1786001175921)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914570049 computed from the segment last modified time of 1786001175919,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:28:44,560] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96030, size=366, lastModifiedTime=1786001244572, largestRecordTimestamp=Some(1786001244575)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914570049 computed from the segment last modified time of 1786001244572,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:28:44,576] INFO Cleaner 0: Swapping in cleaned segment LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001244572, largestRecordTimestamp=Some(1786001244575)) for segment(s) List(LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786000970049, largestRecordTimestamp=Some(1786000970054)), LogSegment(baseOffset=96024, size=366, lastModifiedTime=1786001038666, largestRecordTimestamp=Some(1786001038669)), LogSegment(baseOffset=96026, size=366, lastModifiedTime=1786001107286, largestRecordTimestamp=Some(1786001107288)), LogSegment(baseOffset=96028, size=366, lastModifiedTime=1786001175919, largestRecordTimestamp=Some(1786001175921)), LogSegment(baseOffset=96030, size=366, lastModifiedTime=1786001244572, largestRecordTimestamp=Some(1786001244575))) in log Log(dir=/var/lib/kafka/data/__consumer_offsets-19, topicId=65TBKzdHSpqO7cQgxxECRg, topic=__consumer_offsets, partition=19, highWatermark=96034, lastStableOffset=96034, logStartOffset=0, logEndOffset=96034) (kafka.log.LogCleaner)
[2026-08-06 07:28:44,582] INFO [kafka-log-cleaner-thread-0]:
        Log cleaner thread 0 cleaned log __consumer_offsets-19 (dirty section = [96024, 96032])
        0.0 MB of log processed in 0.0 seconds (0.1 MB/sec).
        Indexed 0.0 MB in 0.0 seconds (0.2 Mb/sec, 20.7% of total time)
        Buffer utilization: 0.0%
        Cleaned 0.0 MB in 0.0 seconds (0.1 Mb/sec, 79.3% of total time)
        Start size: 0.0 MB (13 messages)
        End size: 0.0 MB (5 messages)
        53.2% size reduction (61.5% fewer messages)
 (kafka.log.LogCleaner)
[2026-08-06 07:29:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81512, size=334, lastModifiedTime=1786001038666, largestRecordTimestamp=Some(1786001038667)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:29:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81514 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:29:02,825] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1343, size=1526, lastModifiedTime=1786000965081, largestRecordTimestamp=Some(1786000965085)) (kafka.log.LocalLog$)
[2026-08-06 07:29:02,825] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2/00000000000000001343.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,825] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2/00000000000000001343.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,825] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2/00000000000000001343.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,826] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2/00000000000000001343.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:02,831] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81511, size=168, lastModifiedTime=1786000969913, largestRecordTimestamp=Some(1786000969900)) (kafka.log.LocalLog$)
[2026-08-06 07:29:02,831] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081511.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,832] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081511.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,832] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081511.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,832] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081511.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:02,836] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4412609, size=29771, lastModifiedTime=1786000970125, largestRecordTimestamp=Some(1786000970131)) (kafka.log.LocalLog$)
[2026-08-06 07:29:02,836] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412609.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,836] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412609.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,836] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412609.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,837] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412609.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:02,840] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81107, size=165, lastModifiedTime=1786000970049, largestRecordTimestamp=Some(1786000970049)) (kafka.log.LocalLog$)
[2026-08-06 07:29:02,840] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081107.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,840] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081107.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,840] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081107.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,841] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081107.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:02,844] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413067, size=30514, lastModifiedTime=1786000970085, largestRecordTimestamp=Some(1786000970089)) (kafka.log.LocalLog$)
[2026-08-06 07:29:02,844] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413067.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,845] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413067.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,845] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413067.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:02,846] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413067.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:03,777] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413410 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:29:03,790] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4413410 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:29:03,818] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4412949 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:29:03,827] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4412949 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:29:41,708] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81115 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:29:41,721] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81115 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:29:41,725] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96034 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:29:41,726] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96034 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:29:41,852] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81515 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:29:41,860] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81515 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:29:44,576] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786000970049, largestRecordTimestamp=Some(1786000970054)) (kafka.log.LocalLog$)
[2026-08-06 07:29:44,576] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96024, size=366, lastModifiedTime=1786001038666, largestRecordTimestamp=Some(1786001038669)) (kafka.log.LocalLog$)
[2026-08-06 07:29:44,576] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096024.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,576] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96028, size=366, lastModifiedTime=1786001175919, largestRecordTimestamp=Some(1786001175921)) (kafka.log.LocalLog$)
[2026-08-06 07:29:44,577] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96026, size=366, lastModifiedTime=1786001107286, largestRecordTimestamp=Some(1786001107288)) (kafka.log.LocalLog$)
[2026-08-06 07:29:44,577] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096024.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096024.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096028.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96030, size=366, lastModifiedTime=1786001244572, largestRecordTimestamp=Some(1786001244575)) (kafka.log.LocalLog$)
[2026-08-06 07:29:44,577] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096026.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096028.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096030.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096028.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096030.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096026.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096030.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,577] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096026.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:29:44,582] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096024.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:44,582] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096026.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:44,582] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096028.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:44,582] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096030.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:29:46,629] INFO [Controller id=1001] Processing automatic preferred replica leader election (kafka.controller.KafkaController)
[2026-08-06 07:29:46,629] TRACE [Controller id=1001] Checking need to trigger auto leader balancing (kafka.controller.KafkaController)
[2026-08-06 07:29:46,630] DEBUG [Controller id=1001] Topics not in preferred replica for broker 1001 HashMap() (kafka.controller.KafkaController)
[2026-08-06 07:29:46,630] TRACE [Controller id=1001] Leader imbalance ratio for broker 1001 is 0.0 (kafka.controller.KafkaController)
[2026-08-06 07:30:02,811] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81512, size=334, lastModifiedTime=1786001038666, largestRecordTimestamp=Some(1786001038667)) (kafka.log.LocalLog$)
[2026-08-06 07:30:02,811] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081512.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:30:02,811] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081512.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:30:02,811] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081512.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:30:02,824] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081512.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:30:50,348] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81116 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:30:50,361] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81116 with 0 producer ids in 12 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:30:50,365] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96036 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:30:50,367] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96036 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:31:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81108, size=333, lastModifiedTime=1786001107282, largestRecordTimestamp=Some(1786001107286)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:31:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81110 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:31:02,828] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413153, size=1065, lastModifiedTime=1786001127038, largestRecordTimestamp=Some(1786001127041)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:31:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4413156 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:31:59,045] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81118 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:31:59,058] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81118 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:31:59,062] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96038 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:31:59,064] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96038 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:32:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81110, size=334, lastModifiedTime=1786001175919, largestRecordTimestamp=Some(1786001175919)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:32:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81108, size=333, lastModifiedTime=1786001107282, largestRecordTimestamp=Some(1786001107286)) (kafka.log.LocalLog$)
[2026-08-06 07:32:02,821] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081108.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:32:02,822] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081108.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:32:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081108.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:32:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81112 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:32:02,824] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081108.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:32:02,828] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413153, size=1065, lastModifiedTime=1786001127038, largestRecordTimestamp=Some(1786001127041)) (kafka.log.LocalLog$)
[2026-08-06 07:32:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413153.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:32:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413153.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:32:02,828] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413153.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:32:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413153.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:33:02,223] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413483 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:33:02,236] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4413483 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:33:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81514, size=166, lastModifiedTime=1786001244568, largestRecordTimestamp=Some(1786001244562)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:33:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81110, size=334, lastModifiedTime=1786001175919, largestRecordTimestamp=Some(1786001175919)) (kafka.log.LocalLog$)
[2026-08-06 07:33:02,822] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081110.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:33:02,822] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081110.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:33:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081110.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:33:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81515 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:33:02,824] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081110.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:33:02,828] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81112, size=168, lastModifiedTime=1786001244428, largestRecordTimestamp=Some(1786001244416)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:33:02,829] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81113 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:33:02,834] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 1439 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:33:02,835] INFO [ProducerStateManager partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1] Wrote producer snapshot at offset 1439 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:33:02,835] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1438, size=1530, lastModifiedTime=1786001267636, largestRecordTimestamp=Some(1786001267638)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:33:02,836] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Incremented log start offset to 1439 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:33:06,101] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413026 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:33:06,114] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4413026 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:33:07,683] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81516 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:33:07,696] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81516 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:33:07,700] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96040 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:33:07,702] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96040 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:33:14,596] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-19 (kafka.log.LogCleaner)
[2026-08-06 07:33:14,596] INFO Cleaner 0: Building offset map for __consumer_offsets-19... (kafka.log.LogCleaner)
[2026-08-06 07:33:14,601] INFO Cleaner 0: Building offset map for log __consumer_offsets-19 for 4 segments in offset range [96032, 96040). (kafka.log.LogCleaner)
[2026-08-06 07:33:14,602] INFO Cleaner 0: Offset map for log __consumer_offsets-19 complete. (kafka.log.LogCleaner)
[2026-08-06 07:33:14,602] INFO Cleaner 0: Cleaning log __consumer_offsets-19 (cleaning prior to Thu Aug 06 07:31:59 GMT 2026, discarding tombstones prior to upper bound deletion horizon Wed Aug 05 07:27:24 GMT 2026)... (kafka.log.LogCleaner)
[2026-08-06 07:33:14,602] INFO Cleaner 0: Cleaning LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001244572, largestRecordTimestamp=Some(1786001244575)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914844572 computed from the segment last modified time of 1786001244572,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:33:14,603] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96032, size=366, lastModifiedTime=1786001313200, largestRecordTimestamp=Some(1786001313206)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914844572 computed from the segment last modified time of 1786001313200,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:33:14,603] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96034, size=366, lastModifiedTime=1786001381861, largestRecordTimestamp=Some(1786001381863)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914844572 computed from the segment last modified time of 1786001381861,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:33:14,603] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96036, size=366, lastModifiedTime=1786001450474, largestRecordTimestamp=Some(1786001450477)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914844572 computed from the segment last modified time of 1786001450474,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:33:14,603] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96038, size=366, lastModifiedTime=1786001519214, largestRecordTimestamp=Some(1786001519216)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785914844572 computed from the segment last modified time of 1786001519214,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:33:14,619] INFO Cleaner 0: Swapping in cleaned segment LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001519214, largestRecordTimestamp=Some(1786001519216)) for segment(s) List(LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001244572, largestRecordTimestamp=Some(1786001244575)), LogSegment(baseOffset=96032, size=366, lastModifiedTime=1786001313200, largestRecordTimestamp=Some(1786001313206)), LogSegment(baseOffset=96034, size=366, lastModifiedTime=1786001381861, largestRecordTimestamp=Some(1786001381863)), LogSegment(baseOffset=96036, size=366, lastModifiedTime=1786001450474, largestRecordTimestamp=Some(1786001450477)), LogSegment(baseOffset=96038, size=366, lastModifiedTime=1786001519214, largestRecordTimestamp=Some(1786001519216))) in log Log(dir=/var/lib/kafka/data/__consumer_offsets-19, topicId=65TBKzdHSpqO7cQgxxECRg, topic=__consumer_offsets, partition=19, highWatermark=96042, lastStableOffset=96042, logStartOffset=0, logEndOffset=96042) (kafka.log.LogCleaner)
[2026-08-06 07:33:14,625] INFO [kafka-log-cleaner-thread-0]:
        Log cleaner thread 0 cleaned log __consumer_offsets-19 (dirty section = [96032, 96040])
        0.0 MB of log processed in 0.0 seconds (0.1 MB/sec).
        Indexed 0.0 MB in 0.0 seconds (0.2 Mb/sec, 20.7% of total time)
        Buffer utilization: 0.0%
        Cleaned 0.0 MB in 0.0 seconds (0.1 Mb/sec, 79.3% of total time)
        Start size: 0.0 MB (13 messages)
        End size: 0.0 MB (5 messages)
        53.2% size reduction (61.5% fewer messages)
 (kafka.log.LogCleaner)
[2026-08-06 07:34:02,810] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4412693, size=90282, lastModifiedTime=1786001311700, largestRecordTimestamp=Some(1786001311703)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:34:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81514, size=166, lastModifiedTime=1786001244568, largestRecordTimestamp=Some(1786001244562)) (kafka.log.LocalLog$)
[2026-08-06 07:34:02,823] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081514.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,823] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081514.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081514.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:34:02,823] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081514.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,824] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4412949 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:34:02,828] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81112, size=168, lastModifiedTime=1786001244428, largestRecordTimestamp=Some(1786001244416)) (kafka.log.LocalLog$)
[2026-08-06 07:34:02,829] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81113, size=332, lastModifiedTime=1786001313200, largestRecordTimestamp=Some(1786001313204)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:34:02,829] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081112.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,829] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081112.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,829] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081112.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081112.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:34:02,830] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81115 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:34:02,833] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413156, size=89658, lastModifiedTime=1786001311816, largestRecordTimestamp=Some(1786001311821)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:34:02,834] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4413410 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:34:02,835] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1438, size=1530, lastModifiedTime=1786001267636, largestRecordTimestamp=Some(1786001267638)) (kafka.log.LocalLog$)
[2026-08-06 07:34:02,836] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001438.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,836] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001438.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,836] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001438.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:02,837] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001438.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:34:14,620] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001244572, largestRecordTimestamp=Some(1786001244575)) (kafka.log.LocalLog$)
[2026-08-06 07:34:14,620] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96032, size=366, lastModifiedTime=1786001313200, largestRecordTimestamp=Some(1786001313206)) (kafka.log.LocalLog$)
[2026-08-06 07:34:14,620] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96034, size=366, lastModifiedTime=1786001381861, largestRecordTimestamp=Some(1786001381863)) (kafka.log.LocalLog$)
[2026-08-06 07:34:14,620] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96038, size=366, lastModifiedTime=1786001519214, largestRecordTimestamp=Some(1786001519216)) (kafka.log.LocalLog$)
[2026-08-06 07:34:14,620] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96036, size=366, lastModifiedTime=1786001450474, largestRecordTimestamp=Some(1786001450477)) (kafka.log.LocalLog$)
[2026-08-06 07:34:14,621] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096032.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096034.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096032.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096038.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096034.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096036.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096038.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096036.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096032.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,622] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096036.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,622] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096038.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,621] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096034.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:34:14,625] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096032.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:34:14,625] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096034.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:34:14,625] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096036.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:34:14,625] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096038.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:34:16,329] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81518 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:34:16,341] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81518 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:34:16,346] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96042 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:34:16,348] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96042 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:34:16,493] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81120 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:34:16,502] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81120 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:34:20,156] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413032 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:34:20,166] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4413032 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:34:20,200] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413490 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:34:20,208] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4413490 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:34:46,630] INFO [Controller id=1001] Processing automatic preferred replica leader election (kafka.controller.KafkaController)
[2026-08-06 07:34:46,630] TRACE [Controller id=1001] Checking need to trigger auto leader balancing (kafka.controller.KafkaController)
[2026-08-06 07:34:46,630] DEBUG [Controller id=1001] Topics not in preferred replica for broker 1001 HashMap() (kafka.controller.KafkaController)
[2026-08-06 07:34:46,630] TRACE [Controller id=1001] Leader imbalance ratio for broker 1001 is 0.0 (kafka.controller.KafkaController)
[2026-08-06 07:35:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81515, size=166, lastModifiedTime=1786001381857, largestRecordTimestamp=Some(1786001381850)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,811] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4412693, size=90282, lastModifiedTime=1786001311700, largestRecordTimestamp=Some(1786001311703)) (kafka.log.LocalLog$)
[2026-08-06 07:35:02,822] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412693.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,823] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412693.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,823] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412693.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,824] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81516 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,825] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412693.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:35:02,829] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81113, size=332, lastModifiedTime=1786001313200, largestRecordTimestamp=Some(1786001313204)) (kafka.log.LocalLog$)
[2026-08-06 07:35:02,830] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081113.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,830] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081113.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,830] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081113.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,830] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3, dir=/var/lib/kafka/data] Rolled new log segment at offset 1406 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:35:02,830] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081113.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:35:02,832] INFO [ProducerStateManager partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3] Wrote producer snapshot at offset 1406 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:35:02,832] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1404, size=3044, lastModifiedTime=1786001344849, largestRecordTimestamp=Some(1786001344853)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,833] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413156, size=89658, lastModifiedTime=1786001311816, largestRecordTimestamp=Some(1786001311821)) (kafka.log.LocalLog$)
[2026-08-06 07:35:02,834] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3, dir=/var/lib/kafka/data] Incremented log start offset to 1406 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,834] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413156.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,834] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413156.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,834] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413156.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:35:02,834] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413156.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:35:02,837] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4412949, size=27302, lastModifiedTime=1786001349725, largestRecordTimestamp=Some(1786001349729)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,838] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4413026 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,841] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81115, size=168, lastModifiedTime=1786001381717, largestRecordTimestamp=Some(1786001381706)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,842] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81116 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,845] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413410, size=25890, lastModifiedTime=1786001349565, largestRecordTimestamp=Some(1786001349570)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:35:02,846] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4413483 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:35:23,178] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413699 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:35:23,191] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4413699 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:35:23,334] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413244 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:35:23,343] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4413244 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:35:25,017] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81519 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:35:25,029] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81519 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:35:25,033] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96044 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:35:25,035] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96044 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:36:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81116, size=334, lastModifiedTime=1786001450474, largestRecordTimestamp=Some(1786001450475)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:36:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81515, size=166, lastModifiedTime=1786001381857, largestRecordTimestamp=Some(1786001381850)) (kafka.log.LocalLog$)
[2026-08-06 07:36:02,811] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081515.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,822] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081515.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081515.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,824] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081515.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:36:02,824] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81118 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:36:02,832] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1404, size=3044, lastModifiedTime=1786001344849, largestRecordTimestamp=Some(1786001344853)) (kafka.log.LocalLog$)
[2026-08-06 07:36:02,833] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3/00000000000000001404.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,833] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3/00000000000000001404.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,833] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3/00000000000000001404.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,834] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-3/00000000000000001404.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:36:02,837] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4412949, size=27302, lastModifiedTime=1786001349725, largestRecordTimestamp=Some(1786001349729)) (kafka.log.LocalLog$)
[2026-08-06 07:36:02,838] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412949.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,838] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412949.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,838] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412949.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,838] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004412949.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:36:02,841] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81115, size=168, lastModifiedTime=1786001381717, largestRecordTimestamp=Some(1786001381706)) (kafka.log.LocalLog$)
[2026-08-06 07:36:02,842] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081115.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,842] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081115.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,842] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081115.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,842] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081115.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:36:02,845] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413410, size=25890, lastModifiedTime=1786001349565, largestRecordTimestamp=Some(1786001349570)) (kafka.log.LocalLog$)
[2026-08-06 07:36:02,845] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413410.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,845] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413410.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,845] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413410.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:36:02,846] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413410.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:36:23,234] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413872 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:36:23,248] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4413872 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:36:25,555] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413427 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:36:25,570] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4413427 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:36:33,699] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81121 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:36:33,712] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81121 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:36:33,716] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96046 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:36:33,718] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96046 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:36:33,855] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81521 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:36:33,864] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81521 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:37:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81118, size=332, lastModifiedTime=1786001519210, largestRecordTimestamp=Some(1786001519214)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:37:02,811] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81116, size=334, lastModifiedTime=1786001450474, largestRecordTimestamp=Some(1786001450475)) (kafka.log.LocalLog$)
[2026-08-06 07:37:02,822] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081116.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:37:02,822] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081116.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:37:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081116.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:37:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81120 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:37:02,825] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081116.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:37:30,060] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414026 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:37:30,062] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4414026 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:37:30,098] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413594 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:37:30,106] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4413594 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:37:42,350] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81522 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:37:42,364] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81522 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:37:42,368] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96048 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:37:42,370] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96048 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:37:42,513] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81122 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:37:42,521] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81122 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:37:44,638] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-19 (kafka.log.LogCleaner)
[2026-08-06 07:37:44,638] INFO Cleaner 0: Building offset map for __consumer_offsets-19... (kafka.log.LogCleaner)
[2026-08-06 07:37:44,644] INFO Cleaner 0: Building offset map for log __consumer_offsets-19 for 4 segments in offset range [96040, 96048). (kafka.log.LogCleaner)
[2026-08-06 07:37:44,644] INFO Cleaner 0: Offset map for log __consumer_offsets-19 complete. (kafka.log.LogCleaner)
[2026-08-06 07:37:44,644] INFO Cleaner 0: Cleaning log __consumer_offsets-19 (cleaning prior to Thu Aug 06 07:36:33 GMT 2026, discarding tombstones prior to upper bound deletion horizon Wed Aug 05 07:31:59 GMT 2026)... (kafka.log.LogCleaner)
[2026-08-06 07:37:44,645] INFO Cleaner 0: Cleaning LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001519214, largestRecordTimestamp=Some(1786001519216)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915119214 computed from the segment last modified time of 1786001519214,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:37:44,645] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96040, size=366, lastModifiedTime=1786001587847, largestRecordTimestamp=Some(1786001587850)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915119214 computed from the segment last modified time of 1786001587847,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:37:44,645] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96042, size=366, lastModifiedTime=1786001656500, largestRecordTimestamp=Some(1786001656504)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915119214 computed from the segment last modified time of 1786001656500,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:37:44,645] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96044, size=366, lastModifiedTime=1786001725172, largestRecordTimestamp=Some(1786001725176)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915119214 computed from the segment last modified time of 1786001725172,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:37:44,645] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96046, size=366, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793866)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915119214 computed from the segment last modified time of 1786001793861,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:37:44,661] INFO Cleaner 0: Swapping in cleaned segment LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793866)) for segment(s) List(LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001519214, largestRecordTimestamp=Some(1786001519216)), LogSegment(baseOffset=96040, size=366, lastModifiedTime=1786001587847, largestRecordTimestamp=Some(1786001587850)), LogSegment(baseOffset=96042, size=366, lastModifiedTime=1786001656500, largestRecordTimestamp=Some(1786001656504)), LogSegment(baseOffset=96044, size=366, lastModifiedTime=1786001725172, largestRecordTimestamp=Some(1786001725176)), LogSegment(baseOffset=96046, size=366, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793866))) in log Log(dir=/var/lib/kafka/data/__consumer_offsets-19, topicId=65TBKzdHSpqO7cQgxxECRg, topic=__consumer_offsets, partition=19, highWatermark=96050, lastStableOffset=96050, logStartOffset=0, logEndOffset=96050) (kafka.log.LogCleaner)
[2026-08-06 07:37:44,667] INFO [kafka-log-cleaner-thread-0]:
        Log cleaner thread 0 cleaned log __consumer_offsets-19 (dirty section = [96040, 96048])
        0.0 MB of log processed in 0.0 seconds (0.1 MB/sec).
        Indexed 0.0 MB in 0.0 seconds (0.2 Mb/sec, 20.7% of total time)
        Buffer utilization: 0.0%
        Cleaned 0.0 MB in 0.0 seconds (0.1 Mb/sec, 79.3% of total time)
        Start size: 0.0 MB (13 messages)
        End size: 0.0 MB (5 messages)
        53.2% size reduction (61.5% fewer messages)
 (kafka.log.LogCleaner)
[2026-08-06 07:38:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81118, size=332, lastModifiedTime=1786001519210, largestRecordTimestamp=Some(1786001519214)) (kafka.log.LocalLog$)
[2026-08-06 07:38:02,811] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081118.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:02,811] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081118.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:02,811] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081118.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081118.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:38:30,078] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414228 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:38:30,087] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4414228 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:38:30,241] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4413812 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:38:30,254] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4413812 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:38:44,661] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001519214, largestRecordTimestamp=Some(1786001519216)) (kafka.log.LocalLog$)
[2026-08-06 07:38:44,661] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96040, size=366, lastModifiedTime=1786001587847, largestRecordTimestamp=Some(1786001587850)) (kafka.log.LocalLog$)
[2026-08-06 07:38:44,661] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96042, size=366, lastModifiedTime=1786001656500, largestRecordTimestamp=Some(1786001656504)) (kafka.log.LocalLog$)
[2026-08-06 07:38:44,662] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96046, size=366, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793866)) (kafka.log.LocalLog$)
[2026-08-06 07:38:44,662] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96044, size=366, lastModifiedTime=1786001725172, largestRecordTimestamp=Some(1786001725176)) (kafka.log.LocalLog$)
[2026-08-06 07:38:44,662] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096040.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096042.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096046.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096042.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096046.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096040.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096046.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096042.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096044.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096040.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,662] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096044.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,663] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096044.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:38:44,667] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096040.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:38:44,667] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096042.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:38:44,667] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096044.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:38:44,667] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096046.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:38:50,972] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81523 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:38:50,986] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81523 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:38:50,991] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96050 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:38:50,992] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96050 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:38:51,119] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81123 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:38:51,128] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81123 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:39:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81516, size=334, lastModifiedTime=1786001587847, largestRecordTimestamp=Some(1786001587848)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:39:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81518 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:39:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413026, size=2124, lastModifiedTime=1786001592815, largestRecordTimestamp=Some(1786001592818)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:39:02,828] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4413032 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:39:02,831] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413483, size=2477, lastModifiedTime=1786001592775, largestRecordTimestamp=Some(1786001592777)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:39:02,833] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4413490 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:39:30,176] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414449 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:39:30,185] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4414449 with 0 producer ids in 10 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:39:30,254] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414046 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:39:30,264] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4414046 with 0 producer ids in 10 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:39:46,630] INFO [Controller id=1001] Processing automatic preferred replica leader election (kafka.controller.KafkaController)
[2026-08-06 07:39:46,631] TRACE [Controller id=1001] Checking need to trigger auto leader balancing (kafka.controller.KafkaController)
[2026-08-06 07:39:46,631] DEBUG [Controller id=1001] Topics not in preferred replica for broker 1001 HashMap() (kafka.controller.KafkaController)
[2026-08-06 07:39:46,631] TRACE [Controller id=1001] Leader imbalance ratio for broker 1001 is 0.0 (kafka.controller.KafkaController)
[2026-08-06 07:39:59,612] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81124 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:39:59,624] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81124 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:39:59,629] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96052 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:39:59,631] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96052 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:39:59,738] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81524 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:39:59,747] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81524 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:40:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81516, size=334, lastModifiedTime=1786001587847, largestRecordTimestamp=Some(1786001587848)) (kafka.log.LocalLog$)
[2026-08-06 07:40:02,810] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081516.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,810] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081516.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,811] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081516.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,811] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2, dir=/var/lib/kafka/data] Rolled new log segment at offset 1346 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:40:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081516.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:40:02,824] INFO [ProducerStateManager partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2] Wrote producer snapshot at offset 1346 with 0 producer ids in 12 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:40:02,824] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1344, size=3054, lastModifiedTime=1786001690448, largestRecordTimestamp=Some(1786001690454)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:40:02,826] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2, dir=/var/lib/kafka/data] Incremented log start offset to 1346 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:40:02,827] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413026, size=2124, lastModifiedTime=1786001592815, largestRecordTimestamp=Some(1786001592818)) (kafka.log.LocalLog$)
[2026-08-06 07:40:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413026.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413026.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,828] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413026.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413026.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:40:02,830] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81518, size=168, lastModifiedTime=1786001656336, largestRecordTimestamp=Some(1786001656327)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:40:02,832] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413483, size=2477, lastModifiedTime=1786001592775, largestRecordTimestamp=Some(1786001592777)) (kafka.log.LocalLog$)
[2026-08-06 07:40:02,832] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413483.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,832] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81519 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:40:02,832] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413483.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,832] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413483.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:40:02,833] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413483.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:40:02,835] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81120, size=166, lastModifiedTime=1786001656496, largestRecordTimestamp=Some(1786001656491)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:40:02,836] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81121 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:40:02,840] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 1440 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:40:02,842] INFO [ProducerStateManager partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1] Wrote producer snapshot at offset 1440 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:40:02,842] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1439, size=1530, lastModifiedTime=1786001678224, largestRecordTimestamp=Some(1786001678227)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:40:02,844] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Incremented log start offset to 1440 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:40:30,957] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414826 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:40:30,969] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4414826 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:40:31,000] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414401 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:40:31,009] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4414401 with 0 producer ids in 10 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:41:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81519, size=332, lastModifiedTime=1786001725168, largestRecordTimestamp=Some(1786001725174)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:41:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81521 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:41:02,824] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1344, size=3054, lastModifiedTime=1786001690448, largestRecordTimestamp=Some(1786001690454)) (kafka.log.LocalLog$)
[2026-08-06 07:41:02,825] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2/00000000000000001344.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,825] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2/00000000000000001344.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,825] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2/00000000000000001344.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,827] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-2/00000000000000001344.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:41:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413032, size=76931, lastModifiedTime=1786001710496, largestRecordTimestamp=Some(1786001710500)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:41:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4413244 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:41:02,831] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81518, size=168, lastModifiedTime=1786001656336, largestRecordTimestamp=Some(1786001656327)) (kafka.log.LocalLog$)
[2026-08-06 07:41:02,831] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081518.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,831] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081518.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,831] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081518.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,832] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413490, size=76172, lastModifiedTime=1786001710296, largestRecordTimestamp=Some(1786001710300)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:41:02,832] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081518.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:41:02,833] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4413699 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:41:02,835] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81120, size=166, lastModifiedTime=1786001656496, largestRecordTimestamp=Some(1786001656491)) (kafka.log.LocalLog$)
[2026-08-06 07:41:02,835] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081120.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,835] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081120.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,835] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081120.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,837] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081120.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:41:02,843] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=1439, size=1530, lastModifiedTime=1786001678224, largestRecordTimestamp=Some(1786001678227)) (kafka.log.LocalLog$)
[2026-08-06 07:41:02,843] INFO Deleted log /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001439.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,843] INFO Deleted offset index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001439.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,843] INFO Deleted time index /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001439.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:41:02,844] INFO Deleted producer state snapshot /var/lib/kafka/data/event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-1/00000000000000001439.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:41:08,245] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81125 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:41:08,259] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81125 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:41:08,264] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96054 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:41:08,266] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96054 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:41:08,389] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81525 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:41:08,397] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81525 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:41:35,669] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414485 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:41:35,681] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4414485 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:41:37,227] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414916 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:41:37,241] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4414916 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:42:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81521, size=166, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793854)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:42:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81519, size=332, lastModifiedTime=1786001725168, largestRecordTimestamp=Some(1786001725174)) (kafka.log.LocalLog$)
[2026-08-06 07:42:02,822] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081519.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,822] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081519.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081519.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081519.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:42:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81522 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:42:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413244, size=64728, lastModifiedTime=1786001783317, largestRecordTimestamp=Some(1786001783322)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:42:02,828] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413032, size=76931, lastModifiedTime=1786001710496, largestRecordTimestamp=Some(1786001710500)) (kafka.log.LocalLog$)
[2026-08-06 07:42:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413032.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413032.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,828] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413032.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,828] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4413427 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:42:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413032.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:42:02,831] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81121, size=168, lastModifiedTime=1786001793709, largestRecordTimestamp=Some(1786001793696)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:42:02,832] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413490, size=76172, lastModifiedTime=1786001710296, largestRecordTimestamp=Some(1786001710300)) (kafka.log.LocalLog$)
[2026-08-06 07:42:02,832] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413490.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,832] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413490.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,832] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413490.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:42:02,832] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81122 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:42:02,833] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413490.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:42:02,835] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413699, size=61163, lastModifiedTime=1786001778117, largestRecordTimestamp=Some(1786001778122)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:42:02,837] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4413872 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:42:16,870] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81126 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:42:16,884] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81126 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:42:16,888] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96056 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:42:16,890] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96056 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:42:16,995] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81526 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:42:17,003] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81526 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:42:29,680] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-19 (kafka.log.LogCleaner)
[2026-08-06 07:42:29,680] INFO Cleaner 0: Building offset map for __consumer_offsets-19... (kafka.log.LogCleaner)
[2026-08-06 07:42:29,686] INFO Cleaner 0: Building offset map for log __consumer_offsets-19 for 4 segments in offset range [96048, 96056). (kafka.log.LogCleaner)
[2026-08-06 07:42:29,687] INFO Cleaner 0: Offset map for log __consumer_offsets-19 complete. (kafka.log.LogCleaner)
[2026-08-06 07:42:29,687] INFO Cleaner 0: Cleaning log __consumer_offsets-19 (cleaning prior to Thu Aug 06 07:41:08 GMT 2026, discarding tombstones prior to upper bound deletion horizon Wed Aug 05 07:36:33 GMT 2026)... (kafka.log.LogCleaner)
[2026-08-06 07:42:29,687] INFO Cleaner 0: Cleaning LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793866)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915393861 computed from the segment last modified time of 1786001793861,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:42:29,687] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96048, size=366, lastModifiedTime=1786001862522, largestRecordTimestamp=Some(1786001862523)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915393861 computed from the segment last modified time of 1786001862522,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:42:29,688] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96050, size=366, lastModifiedTime=1786001931126, largestRecordTimestamp=Some(1786001931130)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915393861 computed from the segment last modified time of 1786001931126,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:42:29,688] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96052, size=366, lastModifiedTime=1786001999747, largestRecordTimestamp=Some(1786001999749)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915393861 computed from the segment last modified time of 1786001999747,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:42:29,688] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96054, size=366, lastModifiedTime=1786002068396, largestRecordTimestamp=Some(1786002068400)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915393861 computed from the segment last modified time of 1786002068396,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:42:29,703] INFO Cleaner 0: Swapping in cleaned segment LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786002068396, largestRecordTimestamp=Some(1786002068400)) for segment(s) List(LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793866)), LogSegment(baseOffset=96048, size=366, lastModifiedTime=1786001862522, largestRecordTimestamp=Some(1786001862523)), LogSegment(baseOffset=96050, size=366, lastModifiedTime=1786001931126, largestRecordTimestamp=Some(1786001931130)), LogSegment(baseOffset=96052, size=366, lastModifiedTime=1786001999747, largestRecordTimestamp=Some(1786001999749)), LogSegment(baseOffset=96054, size=366, lastModifiedTime=1786002068396, largestRecordTimestamp=Some(1786002068400))) in log Log(dir=/var/lib/kafka/data/__consumer_offsets-19, topicId=65TBKzdHSpqO7cQgxxECRg, topic=__consumer_offsets, partition=19, highWatermark=96058, lastStableOffset=96058, logStartOffset=0, logEndOffset=96058) (kafka.log.LogCleaner)
[2026-08-06 07:42:29,711] INFO [kafka-log-cleaner-thread-0]:
        Log cleaner thread 0 cleaned log __consumer_offsets-19 (dirty section = [96048, 96056])
        0.0 MB of log processed in 0.0 seconds (0.1 MB/sec).
        Indexed 0.0 MB in 0.0 seconds (0.2 Mb/sec, 22.6% of total time)
        Buffer utilization: 0.0%
        Cleaned 0.0 MB in 0.0 seconds (0.1 Mb/sec, 77.4% of total time)
        Start size: 0.0 MB (13 messages)
        End size: 0.0 MB (5 messages)
        53.2% size reduction (61.5% fewer messages)
 (kafka.log.LogCleaner)
[2026-08-06 07:42:35,807] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414644 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:42:35,821] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4414644 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:42:37,277] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4415060 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:42:37,291] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4415060 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:43:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81522, size=168, lastModifiedTime=1786001862362, largestRecordTimestamp=Some(1786001862349)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:43:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81521, size=166, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793854)) (kafka.log.LocalLog$)
[2026-08-06 07:43:02,821] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081521.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,821] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081521.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,821] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081521.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81523 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:43:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081521.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:43:02,827] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413244, size=64728, lastModifiedTime=1786001783317, largestRecordTimestamp=Some(1786001783322)) (kafka.log.LocalLog$)
[2026-08-06 07:43:02,827] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413244.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,827] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413244.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,827] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413244.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,828] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413427, size=59081, lastModifiedTime=1786001841017, largestRecordTimestamp=Some(1786001841019)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:43:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413244.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:43:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4413594 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:43:02,831] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81121, size=168, lastModifiedTime=1786001793709, largestRecordTimestamp=Some(1786001793696)) (kafka.log.LocalLog$)
[2026-08-06 07:43:02,832] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081121.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,832] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081121.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,832] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081121.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,832] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81122, size=166, lastModifiedTime=1786001862518, largestRecordTimestamp=Some(1786001862511)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:43:02,833] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081121.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:43:02,833] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81123 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:43:02,836] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413699, size=61163, lastModifiedTime=1786001778117, largestRecordTimestamp=Some(1786001778122)) (kafka.log.LocalLog$)
[2026-08-06 07:43:02,836] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413699.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,836] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413699.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,836] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413699.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:02,836] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413872, size=54461, lastModifiedTime=1786001841257, largestRecordTimestamp=Some(1786001841262)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:43:02,837] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413699.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:43:02,838] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4414026 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:43:25,501] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81527 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:43:25,514] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81527 with 0 producer ids in 12 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:43:25,518] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96058 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:43:25,520] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96058 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:43:29,703] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786001793861, largestRecordTimestamp=Some(1786001793866)) (kafka.log.LocalLog$)
[2026-08-06 07:43:29,703] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96048, size=366, lastModifiedTime=1786001862522, largestRecordTimestamp=Some(1786001862523)) (kafka.log.LocalLog$)
[2026-08-06 07:43:29,704] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,704] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,704] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096048.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,704] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096048.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,704] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,704] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096048.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,705] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96050, size=366, lastModifiedTime=1786001931126, largestRecordTimestamp=Some(1786001931130)) (kafka.log.LocalLog$)
[2026-08-06 07:43:29,706] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96052, size=366, lastModifiedTime=1786001999747, largestRecordTimestamp=Some(1786001999749)) (kafka.log.LocalLog$)
[2026-08-06 07:43:29,706] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96054, size=366, lastModifiedTime=1786002068396, largestRecordTimestamp=Some(1786002068400)) (kafka.log.LocalLog$)
[2026-08-06 07:43:29,706] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096050.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,706] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096050.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,706] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096052.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,706] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096050.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,706] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096052.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,706] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096052.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,706] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096054.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,706] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096054.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,706] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096054.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:43:29,711] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096048.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:43:29,711] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096050.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:43:29,711] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096052.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:43:29,711] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096054.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:44:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81523, size=168, lastModifiedTime=1786001930982, largestRecordTimestamp=Some(1786001930970)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:44:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81522, size=168, lastModifiedTime=1786001862362, largestRecordTimestamp=Some(1786001862349)) (kafka.log.LocalLog$)
[2026-08-06 07:44:02,821] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081522.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,821] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081522.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,821] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081522.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81524 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:44:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081522.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:44:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413594, size=77337, lastModifiedTime=1786001909962, largestRecordTimestamp=Some(1786001909964)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:44:02,828] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413427, size=59081, lastModifiedTime=1786001841017, largestRecordTimestamp=Some(1786001841019)) (kafka.log.LocalLog$)
[2026-08-06 07:44:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413427.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413427.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,828] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413427.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4413812 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:44:02,830] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413427.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:44:02,831] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81123, size=165, lastModifiedTime=1786001931126, largestRecordTimestamp=Some(1786001931117)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:44:02,832] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81122, size=166, lastModifiedTime=1786001862518, largestRecordTimestamp=Some(1786001862511)) (kafka.log.LocalLog$)
[2026-08-06 07:44:02,832] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081122.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,832] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081122.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,832] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081122.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,832] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81124 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:44:02,833] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081122.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:44:02,835] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414026, size=71572, lastModifiedTime=1786001910030, largestRecordTimestamp=Some(1786001910031)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:44:02,836] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4414228 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:44:02,837] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413872, size=54461, lastModifiedTime=1786001841257, largestRecordTimestamp=Some(1786001841262)) (kafka.log.LocalLog$)
[2026-08-06 07:44:02,837] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413872.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,837] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413872.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,837] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413872.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:44:02,839] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004413872.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:44:08,692] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414727 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:44:08,706] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4414727 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:44:08,767] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4415129 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:44:08,777] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4415129 with 0 producer ids in 9 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:44:34,145] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81127 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:44:34,160] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81127 with 0 producer ids in 15 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:44:34,164] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96060 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:44:34,166] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96060 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:44:46,631] INFO [Controller id=1001] Processing automatic preferred replica leader election (kafka.controller.KafkaController)
[2026-08-06 07:44:46,631] TRACE [Controller id=1001] Checking need to trigger auto leader balancing (kafka.controller.KafkaController)
[2026-08-06 07:44:46,631] DEBUG [Controller id=1001] Topics not in preferred replica for broker 1001 HashMap() (kafka.controller.KafkaController)
[2026-08-06 07:44:46,631] TRACE [Controller id=1001] Leader imbalance ratio for broker 1001 is 0.0 (kafka.controller.KafkaController)
[2026-08-06 07:45:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81524, size=166, lastModifiedTime=1786001999743, largestRecordTimestamp=Some(1786001999736)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:45:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81523, size=168, lastModifiedTime=1786001930982, largestRecordTimestamp=Some(1786001930970)) (kafka.log.LocalLog$)
[2026-08-06 07:45:02,821] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081523.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,821] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081523.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081523.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,822] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81525 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:45:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081523.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:45:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4413812, size=82756, lastModifiedTime=1786001970219, largestRecordTimestamp=Some(1786001970219)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:45:02,827] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413594, size=77337, lastModifiedTime=1786001909962, largestRecordTimestamp=Some(1786001909964)) (kafka.log.LocalLog$)
[2026-08-06 07:45:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413594.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413594.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,828] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413594.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,828] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4414046 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:45:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413594.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:45:02,831] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81124, size=168, lastModifiedTime=1786001999623, largestRecordTimestamp=Some(1786001999610)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:45:02,832] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81123, size=165, lastModifiedTime=1786001931126, largestRecordTimestamp=Some(1786001931117)) (kafka.log.LocalLog$)
[2026-08-06 07:45:02,832] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081123.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,832] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081123.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,832] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081123.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,832] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81125 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:45:02,833] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081123.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:45:02,835] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414228, size=78175, lastModifiedTime=1786001970059, largestRecordTimestamp=Some(1786001970060)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:45:02,836] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414026, size=71572, lastModifiedTime=1786001910030, largestRecordTimestamp=Some(1786001910031)) (kafka.log.LocalLog$)
[2026-08-06 07:45:02,836] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414026.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,836] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414026.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,836] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414026.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:45:02,837] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414026.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:45:02,838] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4414449 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:45:10,833] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4414971 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:45:10,847] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4414971 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:45:11,040] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4415378 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:45:11,053] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4415378 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:45:42,786] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81529 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:45:42,799] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81529 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:45:42,803] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96062 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:45:42,804] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96062 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:46:02,810] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414046, size=125581, lastModifiedTime=1786002030075, largestRecordTimestamp=Some(1786002030082)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:46:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81524, size=166, lastModifiedTime=1786001999743, largestRecordTimestamp=Some(1786001999736)) (kafka.log.LocalLog$)
[2026-08-06 07:46:02,811] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081524.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,811] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081524.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,811] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081524.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,822] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4414401 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:46:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081524.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:46:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414449, size=133341, lastModifiedTime=1786002029919, largestRecordTimestamp=Some(1786002029923)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:46:02,827] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4413812, size=82756, lastModifiedTime=1786001970219, largestRecordTimestamp=Some(1786001970219)) (kafka.log.LocalLog$)
[2026-08-06 07:46:02,827] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413812.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413812.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,828] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413812.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,828] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004413812.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:46:02,831] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81124, size=168, lastModifiedTime=1786001999623, largestRecordTimestamp=Some(1786001999610)) (kafka.log.LocalLog$)
[2026-08-06 07:46:02,832] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081124.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,832] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081124.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,832] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081124.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,836] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414228, size=78175, lastModifiedTime=1786001970059, largestRecordTimestamp=Some(1786001970060)) (kafka.log.LocalLog$)
[2026-08-06 07:46:02,846] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081124.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:46:02,846] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414228.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:46:02,846] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414228.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,846] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414228.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,846] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414228.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:46:02,847] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4414826 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:46:10,937] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4415128 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:46:10,951] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4415128 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:46:12,575] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4415559 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:46:12,589] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4415559 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:46:32,486] INFO [LocalLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 1417 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:46:32,499] INFO [ProducerStateManager partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0] Wrote producer snapshot at offset 1417 with 0 producer ids in 12 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:46:51,403] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81531 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:46:51,417] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81531 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:46:51,422] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96064 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:46:51,423] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96064 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:46:51,549] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81129 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:46:51,557] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81129 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:46:59,725] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-19 (kafka.log.LogCleaner)
[2026-08-06 07:46:59,725] INFO Cleaner 0: Building offset map for __consumer_offsets-19... (kafka.log.LogCleaner)
[2026-08-06 07:46:59,731] INFO Cleaner 0: Building offset map for log __consumer_offsets-19 for 4 segments in offset range [96056, 96064). (kafka.log.LogCleaner)
[2026-08-06 07:46:59,731] INFO Cleaner 0: Offset map for log __consumer_offsets-19 complete. (kafka.log.LogCleaner)
[2026-08-06 07:46:59,731] INFO Cleaner 0: Cleaning log __consumer_offsets-19 (cleaning prior to Thu Aug 06 07:45:42 GMT 2026, discarding tombstones prior to upper bound deletion horizon Wed Aug 05 07:41:08 GMT 2026)... (kafka.log.LogCleaner)
[2026-08-06 07:46:59,731] INFO Cleaner 0: Cleaning LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786002068396, largestRecordTimestamp=Some(1786002068400)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915668396 computed from the segment last modified time of 1786002068396,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:46:59,732] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96056, size=366, lastModifiedTime=1786002137001, largestRecordTimestamp=Some(1786002137006)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915668396 computed from the segment last modified time of 1786002137001,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:46:59,732] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96058, size=366, lastModifiedTime=1786002205641, largestRecordTimestamp=Some(1786002205645)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915668396 computed from the segment last modified time of 1786002205641,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:46:59,732] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96060, size=366, lastModifiedTime=1786002274286, largestRecordTimestamp=Some(1786002274290)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915668396 computed from the segment last modified time of 1786002274286,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:46:59,732] INFO Cleaner 0: Cleaning LogSegment(baseOffset=96062, size=366, lastModifiedTime=1786002342907, largestRecordTimestamp=Some(1786002342909)) in log __consumer_offsets-19 into 0 with an upper bound deletion horizon 1785915668396 computed from the segment last modified time of 1786002342907,retaining deletes. (kafka.log.LogCleaner)
[2026-08-06 07:46:59,748] INFO Cleaner 0: Swapping in cleaned segment LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786002342907, largestRecordTimestamp=Some(1786002342909)) for segment(s) List(LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786002068396, largestRecordTimestamp=Some(1786002068400)), LogSegment(baseOffset=96056, size=366, lastModifiedTime=1786002137001, largestRecordTimestamp=Some(1786002137006)), LogSegment(baseOffset=96058, size=366, lastModifiedTime=1786002205641, largestRecordTimestamp=Some(1786002205645)), LogSegment(baseOffset=96060, size=366, lastModifiedTime=1786002274286, largestRecordTimestamp=Some(1786002274290)), LogSegment(baseOffset=96062, size=366, lastModifiedTime=1786002342907, largestRecordTimestamp=Some(1786002342909))) in log Log(dir=/var/lib/kafka/data/__consumer_offsets-19, topicId=65TBKzdHSpqO7cQgxxECRg, topic=__consumer_offsets, partition=19, highWatermark=96066, lastStableOffset=96066, logStartOffset=0, logEndOffset=96066) (kafka.log.LogCleaner)
[2026-08-06 07:46:59,753] INFO [kafka-log-cleaner-thread-0]:
        Log cleaner thread 0 cleaned log __consumer_offsets-19 (dirty section = [96056, 96064])
        0.0 MB of log processed in 0.0 seconds (0.1 MB/sec).
        Indexed 0.0 MB in 0.0 seconds (0.2 Mb/sec, 21.4% of total time)
        Buffer utilization: 0.0%
        Cleaned 0.0 MB in 0.0 seconds (0.1 Mb/sec, 78.6% of total time)
        Start size: 0.0 MB (13 messages)
        End size: 0.0 MB (5 messages)
        53.2% size reduction (61.5% fewer messages)
 (kafka.log.LogCleaner)
[2026-08-06 07:47:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81525, size=166, lastModifiedTime=1786002068392, largestRecordTimestamp=Some(1786002068387)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:47:02,810] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414046, size=125581, lastModifiedTime=1786002030075, largestRecordTimestamp=Some(1786002030082)) (kafka.log.LocalLog$)
[2026-08-06 07:47:02,811] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414046.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:02,822] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414046.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:02,822] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414046.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414046.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:47:02,824] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81526 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:47:02,827] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414449, size=133341, lastModifiedTime=1786002029919, largestRecordTimestamp=Some(1786002029923)) (kafka.log.LocalLog$)
[2026-08-06 07:47:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414449.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414449.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:02,828] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414449.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414401, size=29701, lastModifiedTime=1786002075500, largestRecordTimestamp=Some(1786002075506)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:47:02,830] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4414485 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:47:02,833] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81125, size=167, lastModifiedTime=1786002068256, largestRecordTimestamp=Some(1786002068244)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:47:02,834] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81126 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:47:02,837] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414826, size=31871, lastModifiedTime=1786002075536, largestRecordTimestamp=Some(1786002075541)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:47:02,838] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4414916 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:47:02,847] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414449.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:47:10,956] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4415661 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:47:10,971] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4415661 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:47:12,602] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4416097 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:47:12,615] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4416097 with 0 producer ids in 12 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:47:59,748] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=0, size=1290, lastModifiedTime=1786002068396, largestRecordTimestamp=Some(1786002068400)) (kafka.log.LocalLog$)
[2026-08-06 07:47:59,748] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96056, size=366, lastModifiedTime=1786002137001, largestRecordTimestamp=Some(1786002137006)) (kafka.log.LocalLog$)
[2026-08-06 07:47:59,748] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96058, size=366, lastModifiedTime=1786002205641, largestRecordTimestamp=Some(1786002205645)) (kafka.log.LocalLog$)
[2026-08-06 07:47:59,748] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96060, size=366, lastModifiedTime=1786002274286, largestRecordTimestamp=Some(1786002274290)) (kafka.log.LocalLog$)
[2026-08-06 07:47:59,749] INFO [UnifiedLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=96062, size=366, lastModifiedTime=1786002342907, largestRecordTimestamp=Some(1786002342909)) (kafka.log.LocalLog$)
[2026-08-06 07:47:59,749] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096058.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096056.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096058.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096056.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096062.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted log /var/lib/kafka/data/__consumer_offsets-19/00000000000000096060.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096062.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096056.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000000000.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096058.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096062.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted offset index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096060.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,749] INFO Deleted time index /var/lib/kafka/data/__consumer_offsets-19/00000000000000096060.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:47:59,753] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096056.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:47:59,753] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096058.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:47:59,753] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096060.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:47:59,754] INFO Deleted producer state snapshot /var/lib/kafka/data/__consumer_offsets-19/00000000000000096062.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:48:00,042] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81130 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:48:00,055] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81130 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:48:00,060] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96066 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:48:00,061] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96066 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:48:00,169] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81532 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:48:00,178] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81532 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:48:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81526, size=166, lastModifiedTime=1786002137001, largestRecordTimestamp=Some(1786002136993)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:48:02,811] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81525, size=166, lastModifiedTime=1786002068392, largestRecordTimestamp=Some(1786002068387)) (kafka.log.LocalLog$)
[2026-08-06 07:48:02,821] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081525.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,822] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081525.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081525.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81527 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:48:02,824] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081525.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:48:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414485, size=56275, lastModifiedTime=1786002155317, largestRecordTimestamp=Some(1786002155320)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:48:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4414644 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:48:02,829] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414401, size=29701, lastModifiedTime=1786002075500, largestRecordTimestamp=Some(1786002075506)) (kafka.log.LocalLog$)
[2026-08-06 07:48:02,830] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414401.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,830] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414401.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,830] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414401.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,831] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414401.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:48:02,831] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81126, size=168, lastModifiedTime=1786002136881, largestRecordTimestamp=Some(1786002136868)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:48:02,833] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81127 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:48:02,833] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81125, size=167, lastModifiedTime=1786002068256, largestRecordTimestamp=Some(1786002068244)) (kafka.log.LocalLog$)
[2026-08-06 07:48:02,834] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081125.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,834] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081125.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,834] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081125.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,835] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081125.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:48:02,835] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414916, size=50932, lastModifiedTime=1786002157189, largestRecordTimestamp=Some(1786002157194)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:48:02,837] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4415060 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:48:02,837] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414826, size=31871, lastModifiedTime=1786002075536, largestRecordTimestamp=Some(1786002075541)) (kafka.log.LocalLog$)
[2026-08-06 07:48:02,838] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414826.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,838] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414826.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,838] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414826.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:48:02,838] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414826.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:48:14,695] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 4416310 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:48:14,709] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0] Wrote producer snapshot at offset 4416310 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:48:15,057] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 4416722 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:48:15,059] INFO [ProducerStateManager partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1] Wrote producer snapshot at offset 4416722 with 0 producer ids in 2 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:49:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81527, size=334, lastModifiedTime=1786002205641, largestRecordTimestamp=Some(1786002205643)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:49:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81526, size=166, lastModifiedTime=1786002137001, largestRecordTimestamp=Some(1786002136993)) (kafka.log.LocalLog$)
[2026-08-06 07:49:02,821] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081526.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,821] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081526.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081526.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081526.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:49:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Incremented log start offset to 81529 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:49:02,827] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4414644, size=29348, lastModifiedTime=1786002212217, largestRecordTimestamp=Some(1786002212221)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:49:02,828] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414485, size=56275, lastModifiedTime=1786002155317, largestRecordTimestamp=Some(1786002155320)) (kafka.log.LocalLog$)
[2026-08-06 07:49:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414485.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414485.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,829] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414485.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,829] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Incremented log start offset to 4414727 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:49:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414485.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:49:02,832] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81126, size=168, lastModifiedTime=1786002136881, largestRecordTimestamp=Some(1786002136868)) (kafka.log.LocalLog$)
[2026-08-06 07:49:02,832] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081126.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,832] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081126.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,832] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081126.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,832] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=4415060, size=24418, lastModifiedTime=1786002212265, largestRecordTimestamp=Some(1786002212270)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:49:02,833] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-1/00000000000000081126.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:49:02,833] INFO [UnifiedLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Incremented log start offset to 4415129 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:49:02,836] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414916, size=50932, lastModifiedTime=1786002157189, largestRecordTimestamp=Some(1786002157194)) (kafka.log.LocalLog$)
[2026-08-06 07:49:02,836] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414916.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,836] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414916.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,836] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414916.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:49:02,837] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004414916.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:49:08,671] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81131 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:49:08,685] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81131 with 0 producer ids in 14 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:49:08,689] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96068 in 1 ms. (kafka.log.LocalLog)
[2026-08-06 07:49:08,691] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96068 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:49:46,631] INFO [Controller id=1001] Processing automatic preferred replica leader election (kafka.controller.KafkaController)
[2026-08-06 07:49:46,632] TRACE [Controller id=1001] Checking need to trigger auto leader balancing (kafka.controller.KafkaController)
[2026-08-06 07:49:46,632] DEBUG [Controller id=1001] Topics not in preferred replica for broker 1001 HashMap() (kafka.controller.KafkaController)
[2026-08-06 07:49:46,632] TRACE [Controller id=1001] Leader imbalance ratio for broker 1001 is 0.0 (kafka.controller.KafkaController)
[2026-08-06 07:50:02,810] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=81127, size=333, lastModifiedTime=1786002274286, largestRecordTimestamp=Some(1786002274288)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:50:02,810] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=81527, size=334, lastModifiedTime=1786002205641, largestRecordTimestamp=Some(1786002205643)) (kafka.log.LocalLog$)
[2026-08-06 07:50:02,821] INFO Deleted log /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081527.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,821] INFO Deleted offset index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081527.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,822] INFO Deleted time index /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081527.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,823] INFO [UnifiedLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Incremented log start offset to 81129 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:50:02,823] INFO Deleted producer state snapshot /var/lib/kafka/data/voyager.topics.daim.gateway.endpoint_status-0/00000000000000081527.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:50:02,828] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4414644, size=29348, lastModifiedTime=1786002212217, largestRecordTimestamp=Some(1786002212221)) (kafka.log.LocalLog$)
[2026-08-06 07:50:02,828] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0, dir=/var/lib/kafka/data] Deleting segment LogSegment(baseOffset=1416, size=1526, lastModifiedTime=1786002289790, largestRecordTimestamp=Some(1786002289793)) due to retention time 300000ms breach based on the largest record timestamp in the segment (kafka.log.UnifiedLog)
[2026-08-06 07:50:02,828] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414644.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,828] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414644.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,829] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414644.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,829] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-0/00000000000004414644.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:50:02,829] INFO [UnifiedLog partition=event.ea3ce202-8fd5-5c74-8ceb-28c612278133.dubai-people-detection_person.analytics_event-0, dir=/var/lib/kafka/data] Incremented log start offset to 1417 due to segment deletion (kafka.log.UnifiedLog)
[2026-08-06 07:50:02,832] INFO [LocalLog partition=metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1, dir=/var/lib/kafka/data] Deleting segment files LogSegment(baseOffset=4415060, size=24418, lastModifiedTime=1786002212265, largestRecordTimestamp=Some(1786002212270)) (kafka.log.LocalLog$)
[2026-08-06 07:50:02,832] INFO Deleted log /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004415060.log.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,832] INFO Deleted offset index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004415060.index.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,832] INFO Deleted time index /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004415060.timeindex.deleted. (kafka.log.LogSegment)
[2026-08-06 07:50:02,833] INFO Deleted producer state snapshot /var/lib/kafka/data/metadata.f400183e-6155-563e-a899-ef438b87cde3.detections.deepstream_minimal-1/00000000000004415060.snapshot.deleted (kafka.log.SnapshotFile)
[2026-08-06 07:50:17,294] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-1, dir=/var/lib/kafka/data] Rolled new log segment at offset 81133 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:50:17,307] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-1] Wrote producer snapshot at offset 81133 with 0 producer ids in 13 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:50:17,311] INFO [LocalLog partition=__consumer_offsets-19, dir=/var/lib/kafka/data] Rolled new log segment at offset 96070 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:50:17,313] INFO [ProducerStateManager partition=__consumer_offsets-19] Wrote producer snapshot at offset 96070 with 0 producer ids in 1 ms. (kafka.log.ProducerStateManager)
[2026-08-06 07:50:17,420] INFO [LocalLog partition=voyager.topics.daim.gateway.endpoint_status-0, dir=/var/lib/kafka/data] Rolled new log segment at offset 81533 in 2 ms. (kafka.log.LocalLog)
[2026-08-06 07:50:17,428] INFO [ProducerStateManager partition=voyager.topics.daim.gateway.endpoint_status-0] Wrote producer snapshot at offset 81533 with 0 producer ids in 8 ms. (kafka.log.ProducerStateManager)
